Entropy and Information in Neural Spike Trains
نویسندگان
چکیده
The nervous system represents time dependent signals in sequences of discrete, identical action potentials or spikes; information is carried only in the spike arrival times. We show how to quantify this information, in bits, free from any assumptions about which features of the spike train or input signal are most important, and we apply this approach to the analysis of experiments on a motion sensitive neuron in the fly visual system. This neuron transmits information about the visual stimulus at rates of up to 90 bitsys, within a factor of 2 of the physical limit set by the entropy of the spike train itself. [S0031-9007(97)04939-9]
منابع مشابه
Differential Entropy of Multivariate Neural Spike Trains
Most approaches to analysing the spatiotemporal dynamics of neural populations involve binning spike trains. This is likely to underestimate the information carried by spike timing codes, in practice, if they involve high precision patterns of inter-spike intervals (ISIs). In this paper we set out to investigate the differential entropy of multivariate neural spike trains, following the work of...
متن کاملTime resolution dependence of information measures for spiking neurons: scaling and universality
The mutual information between stimulus and spike-train response is commonly used to monitor neural coding efficiency, but neuronal computation broadly conceived requires more refined and targeted information measures of input-output joint processes. A first step toward that larger goal is to develop information measures for individual output processes, including information generation (entropy...
متن کاملTime Resolution Dependence of Information Measures for Spiking Neurons: Atoms, Scaling, and Universality
The mutual information between stimulus and spike-train response is commonly used to monitor neural coding efficiency, but neuronal computation broadly conceived requires more refined and targeted information measures of input-output joint processes. A first step towards that larger goal is to develop information measures for individual output processes, including information generation (entrop...
متن کاملThe Computational Structure of Spike Trains
Neurons perform computations, and convey the results of those computations through the statistical structure of their output spike trains. Here we present a practical method, grounded in the information-theoretic analysis of prediction, for inferring a minimal representation of that structure and for characterizing its complexity. Starting from spike trains, our approach finds their causal stat...
متن کاملParameter Estimation for Spatio-Temporal Maximum Entropy Distributions: Application to Neural Spike Trains
We propose a numerical method to learn Maximum Entropy (MaxEnt) distributions with spatio-temporal constraints from experimental spike trains. This is an extension of two papers [10] and [4] who proposed the estimation of parameters where only spatial constraints were taken into account. The extension we propose allows to properly handle memory effects in spike statistics, for large sized neura...
متن کاملEntropy and information in neural spike trains: progress on the sampling problem.
The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy-like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to synthetic data inspired by experiments, and to real experimental spike trains. The estimator performs admirably even very deep in the undersampled regime, where oth...
متن کامل